-
Notifications
You must be signed in to change notification settings - Fork 25.6k
Add benchmark script #126596
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add benchmark script #126596
Conversation
Adds a simple script to run benchmarks for ESQL and collect their results. The script has a `--test` mode which takes about ten minutes. Running without `--test` takes a four hours fifteen minutes. To speed up `--test` I reworked the "self test" that each benchmark runs to be optional and disabled in `--test` mode.
|
Pinging @elastic/es-analytical-engine (Team:Analytics) |
| valuesBigArray, | ||
| totalPositions, | ||
| null, | ||
| IntStream.rangeClosed(0, totalPositions).toArray(), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
These were required to run the self-test with assertions enabled. Which we do when we run them in tests.
| case TWO_LONGS -> List.of(ElementType.INT, ElementType.INT); | ||
| case LONGS_AND_BYTES_REFS -> List.of(ElementType.INT, ElementType.BYTES_REF); | ||
| case TWO_LONGS -> List.of(ElementType.LONG, ElementType.LONG); | ||
| case LONGS_AND_BYTES_REFS -> List.of(ElementType.LONG, ElementType.BYTES_REF); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
These were just mistakes.
| Page page = page(data); | ||
| for (int i = 0; i < 1024; i++) { | ||
| operator.addInput(page); | ||
| operator.addInput(page.shallowCopy()); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Mistake.
|
Here's the output from my laptop: esql_values_source_reader.json |
Adds a simple script to run benchmarks for ESQL and collect their results. The script has a
--testmode which takes about ten minutes. Running without--testtakes a four hours fifteen minutes.To speed up
--testI reworked the "self test" that each benchmark runs to be optional and disabled in--testmode.